![]() |
VIVE 3DSP Native C Library
ver 1.0.0.0
Audio 3DSP (3D Sound Perception) Native C Library
|
The HTC VIVE 3DSP SDK provides an audio solution for simulating realistic sounds inside the virtual world. This SDK provides the tools you need to create engaging and immersive spatial audio for your VR apps or experiences.
The HTC VIVE 3DSP SDK is made for VR content developers. We designed and implemented a host of features to provide developers a rapid spatial audio solution. The audio quality and audio source localization could be optimized further if the VIVE Pro headset is used. There are some improvements made specifically for the audio system provided in the VIVE Pro headset.
Ambisonics is the technology that uses a full-sphere surround sound technique to simulate spatial sound. It counts the sound pressure changes around the listener by spherical harmonics.
The order of the spherical harmonics is also called the order of ambisonics. The order of ambisonics has a big influence on the realistic depiction of the direction of sound. Therefore, we use 3rd order ambisonics as our spatial audio model as it generates spatial sound with better directivity and higher resolution.
The higher the order has been used, the higher computing power is required for the ambisonic process. The patent pending technique has been applied on our ambisonic process that it requires as low computing power as the first order ambisonic, even though 3rd order is used in our 3DSP mode.
Our reverberation feature uses the cubic shape model. It simulates the room reverberation by the early reflection and late reverberation models. The early reflection is the reflected sounds within a few milliseconds, and we simulate these reflected sounds through delay.
There is also an option to choose the material for each wall (wood, carpet, concrete, and glass) in a room. Different wall materials produce different types of reflections. After the first reflection, the sound encounters more reflections and mixes with the background sound. The resulting sound could not be simulated by large amount of reflections so we needed to come up with a well-designed formula to generate accurate late reverberation.
When a sound source approaches or moves away from the user, the sound that the user hears should also change depending on the distance between the sound source and the user. For this scenario, we use the inverse square law to determine the change in the sound levels.
In our SDK, we also provide the real-world distance effect which measures the response at different distances between the sound source and listener and then apply the proper response measurement. Also the quadratic and linear decreasing models have been provided as well.
The occlusion effect is used to accurately simulate what happens to sound when it encounters an obstacle in its path. The resulting sound produced depends on the material (window, thin door, wood wall, stone wall, and curtain) and thickness of the obstacles that the sound encounters in its path. In our SDK, we also provide a binaural occlusion mode which simulates a more realistic binaural sound in VR.
Instead of CD - 16-bit/44.1kHz audio, the SDK also supports high-resolustion audio files with a sampling frequency of 96 kHz or 192 kHz at 24-bit.
To get started, you can refer the supplied example codes, which show how to create an audio engine, use the engine to render audio and occlusion objects, set the parameters of the reverb room, and even adjust the listener's rotation when processing audio frames. For now, the example are available on Windows x86/x64 platforms. To build the example you can use the provided Visual Studio solution.
The API supports to control the following component:
The vive_3dsp_context structure is the main component that represents the audio engine. It represents an audio processing unit and serves as a container for all other elements (sources, listener, room ...). It controls the execution of the audio processing and manages some global settings. You need to create a vive_3dsp_context by using vive_3dsp_audio_create() before doing anything else as all other components of the engine must be created in a context. Use vive_3dsp_audio_destroy() to shutdown the audio engine.
You can set the listener's position and rotation using vive_3dsp_listener_set_position() and vive_3dsp_listener_set_rotation(). If you have Vive Pro HMD, you can enhance the sound effect by setting your headset model using vive_3dsp_listener_set_headset().
The sound engine supports multiple audio sources process simultaneously. You can control each individual source with source ID given by vive_3dsp_source_create_object(), for example, set its position or output volume. Each audio source object contains its own signal path with 3D sound effects. You can therefore process different audio clips using vive_3dsp_source_process() on different audio sources.
The API allows you to set the cubic room size, materials or reflection of each wall, and switch on/off it as well as audio source. You can create and destroy an audio room by vive_3dsp_room_create_object() and vive_3dsp_room_destroy_object(). When an audio source or listener enters the same room, the audio engnie will automatically enable the room effect on the specific audio source to make it broader and more immersive. You can also change the material of each wall by vive_3dsp_room_set_material() and vive_3dsp_room_set_reflection().
You can create and destroy an occlusion object using vive_3dsp_occlusion_create_object() and vive_3dsp_occlusion_destroy_object(). By using VIVE 3DSP occlusion engine, you can specify the geometric shape of the object and the engine can estimate the occlusive cover ratio to make the sound absorted. It also allows you to control the cover ratio directly using vive_3dsp_occlusion_set_cover_ratio(). If your application supports binaural occlusion mode by vive_3dsp_occlusion_set_channel_num(), you can control the cover ratio of each individual channel using vive_3dsp_occlusion_set_channel_cover_ratio().
Features
Bug Fixed
Feature Changed
Bug Fixed
Features
Features
Bug Fixed
Bug Fixed
Features
Features
Bug Fixed
- Occlusion effect issues happen when the listener near the corners of the obstacles.
Features
Bug Fixed
Features
Bug Fixed
Features
Bug Fixed
Features
Features
Features
Features
Features
Bug Fixed
Features
1.8.14